INTRICACIES OF DEPENDENCE BETWEEN COMPONENTS OF 
MULTIVARIATE MARKOV CHAINS: WEAK MARKOV 
CONSISTENCY AND WEAK MARKOV COPULAE 



TOMASZ R. BIELECKI, JACEK JAKUBOWSKI, AND MARIUSZ NIEW^GLOWSKI 



Abstract. In this paper we examine the problem of existence and construction of multivariate 
Markov chains such that their components are Markov chains with given laws. Specifically, we 
provide sufficient and necessary conditions, in terms of semimartingale characteristics, for a com- 
ponent of a multivariate Markov chain to be a Markov chain in its own filtration - a property called 
weak Markov consistency. Accordingly, we introduce and discuss the concept of weak Markov cop- 
ulae. Finally, we examine relationship between the concepts of weak Markov consistency and weak 
Markov copulae, and the corresponding strong versions of these concepts. 
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Introduction 

Modeling of dependence between stochastic processes is a very important issue arising from many 
different applications, among others in financial mathematics. By modeling dependence we mean 
construction of a multivariate stochastic process with prescribed marginal laws. In this paper we 
focus on Markov chains, and deal with the problem of constructing a multivariate Markov chain 
such that its components are given Markov chains in their own filtrations. It is well known that 
components of multivariate Markov process are in general not Markovian (in any filtration) , so the 
problem that we study here is by no means a trivial one. We give sufficient and necessary conditions, 
in terms of the semimartingale characteristics, for a component of a multivariate Markov chain to 
be a Markov chain in its own filtration. 

Our paper continues the study of Markovian consistency and Markov copulae for multivariate 
Markov processes, initiated in P], [S], [H] and [7]. 

Here, we introduce and study the concept of weak Markovian consistency, and we relate it to 
the concept of strong Markovian consistency that was explored in the aforementioned papers under 
the name of Markovian consistency. We also continue the study of dependence between Markov 
processes. Thus, we continue the study of Markov copulae, the concept originally introduced in P]. 
Specifically, we introduce and examine Markov copulae with regard to weak Markovian consistency. 
It turns out that certain unwanted features of Markov copulae, inherent to the framework of strong 
Markovian consistency, are no longer present in the framework of weak Markovian consistency. This 
is particularly pleasing in view of applications of Markov copulae in credit risk management or 
in reliability management; in fact, this aspect of weak Markov copulae makes them exceptionally 
important tool in modeling dynamic dependence. We provide more insight into this important issue 
in Remark 1 2. II 

As already said, we confine our discussion, for the most part, to the case of finite Markov chains. 
One might object the choice of finite Markov chains as the of object of interest in this paper, as one 
might think that this choice is very restrictive. In [7] we studied strong Markovian dependence in the 
context of (nice) Feller processes. What we learned while working on paper [7| and while working on 
the present paper, is that from the point of view of intricacies of dependence between components 
of a multivariate Markov process, the finite state space set-up is actually not restrictive at all! The 
dependence here is equally intricate as dependence in the case of general Feller process, which is 
much harder to present, due to various technicalities that obscure the dependence picture. That 
is why, with the benefit for the reader, we are presenting here a study of the intricate dependence 
between components of finite Markov chains, which does not require any use of sophisticated technical 
machinery, but at the same allows for pointing to the essence of the of intricacies of dependence 
between components of a multivariate Markov process. 

It needs to be noted that problems that we study in the present paper are also connected with 
lumpability problem for continuous time Markov chains (see Ball and Yeo [T] and discussion there. 
Burke and Rosenblatt [5]). In [T] necessary and sufficient conditions are provided for intensity matrix 
so that the marginal component process of a Markov chain is a time homogenous continuous time 
Markov chain in its natural filtration. If we omit the assumption of time homogeneity and weaken 
assumption on intensity matrix, then there exist Markov process with marginals being also Markov 
in their own filtration which does not satisfy conditions from [1] (see Example 3.2.). Moreover 
assumptions imposed in these papers on intensity matrix exclude Markov chains with absorbing 
states, a case that can be treated using our methodology. 

In case of a bivariate Markov chain, one can also note some similarity between our work and the 
studies of Markovian coupling (see e.g. Chen [H Sect. 1.5.2]). It needs to be stressed though that the 
concepts of weak Markovian consistency and weak Markovian copulae are much more than (standard) 
coupling of Markov chains; and this not just because these concepts apply to multivariate case and 
not only to the bivariate case. Markovian couplings deal with marginal properties of transition 
probabilities (cf. equations (5.7) in [9]) and with "marginal'' properties of generators (cf. equations 
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(5.8) in [S]). Specifically, the properties looked at within the Markovian coupling universe, that are 
somewhat relevant to our present work, amount to 

(1) the property that marginals of a bivariate transition probability are equal to given univariate 
transition probabilities (cf. equations (5.7) in [S]), and 

(2) the property that "univariate projections" of a bivariate Markovian generator are equal to 
given univariate Markovian generators (cf. equations (5.8) in [9]). 

This however is much less than dealing with the marginal laws of a process in the sense of 

• asking questions regarding Markovian consistency: that is, asking questions regarding nec- 
essary and sufficient conditions that need to be satisfied by the generator of a multivariate 
Markov chain, such that the chain's components are Markovian either in their own filtrations 
(the property of weak Markovian consistency), or are Markovian either in the filtration of 
the entire multivariate process (the property of strong Markovian consistency), or are not 
Markovian at all. 

• asking questions regarding Markov copulae: that is, asking questions regarding construction 
of a generator of a multivariate Markov chain, such that the chain's components are Mar- 
kovian either in their own filtrations and their laws coincide with the laws of given univariate 
Markov chains (i.e. construction of a weak Markovian copula), or the chain's components 
are Markovian in the filtration of the entire multivariate process and their laws coincide with 
the laws of given univariate Markov chains (i.e. construction of a strong Markovian copula). 

In addition, studies of Markovian coupling do not touch the issues of intricate nature of dependence 
between components of a multivariate Markov chain, that we study and demonstrate in this paper. 

The paper is organized as follows. In Section 1 we give a sufficient and necessary condition 
for a multivariate Markov chain to be weakly consistent. Note that a sufficient condition for weak 
Markovian consistency can be deduced from the result of Rogers and Pitman |14| in which sufficient 
conditions for a function of a Markov process to be a Markov process are given. Our condition 
for a weak Markovian consistency is not only more explicit, but also necessary. We also study the 
question when weak Markovian consistency implies strong Markovian consistency. It turns out that 
this is equivalent to P- immersion between F"**^ and F"^, given that weak Markovian consistency holds. 
In Section 2 we study weak Markov copulae. In Section 3 we present three simple, but non-trivial 
examples, that illustrate intricacies of dependence between components of a multivariate Markov 
chain. Specifically, in Examples 3.1-3.3 we show that 

(1) there exist Markov processes that are strongly Markovian consistent, 

(2) there exist Markov processes that are weakly Markovian consistent, but are not strongly 
Markovian consistent; in addition, in this case, one would expect that even if a multivari- 
ate Markov process is time-homogeneous, its components are time-inhomogeneous Markov 
processes; Example 3.2 illustrates this, 

(3) there exist Markov processes that are neither strongly Markovian consistent nor weakly 
Markovian consistent. 

1. Markovian Consistency 

As already said, we shall focus in this paper on the case of finite Markov chains. Nevertheless, 
we shall formulate the concept of weak Markovian consistency in more generality. Towards this 
end we consider X = (X", n = 1, . . . , N), a multivariate Markov process, defined on an underlying 
probabihty space (fl, T, P), taking values in R^Q We denote by F"^ the filtration of X, and by F-^" 
the filtration of the coordinate X" of X. It is well known that, in general, the coordinates of X are 
not Markov with respect to their own filtrations. 



The study presented in this paper carries over to the case of multivariate Markov process taking values in a 
product of arbitrary (metric) spaces. 
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Definition 1.1. (i) Let us fix n. We say that the process X satisfies the weak Markovian consistency 
condition with respect to the component X" if for every B G S(M) and all t, s > 0, 

(I) P (xi\, e B\Tr ) - P (XIX., e B\x^) , 



so that the component X" of X is a Markov process in its own filtration. 

(ii) If X satisfies the weak Markovian consistency condition with respect to X" for each n € 
{1, . . . , N}, then we say that X satisfies the weak Markovian consistency condition. 

Previously, in [3], [S], [5] and [7], a stronger concept was studied. 

Definition 1.2. (i) Let us fix n. We say that the process X satisfies the strong Markovian consis- 
tency condition with respect to the component X" if for every B G B(M.) and all t, s > 0, 

(2) P (xr+. e BlTi") = P e B\X^) 

or equivalently 

(3) P (x.'V, e B\Xt) - P (xf^, e B\x^) , 

so that X" is a Markov process in the filtration of X. 

(ii) If X satisfies the strong Markovian consistency condition with respect to X" for each n € 
{1, . . . , N}, then we say that X satisfies the strong Markovian consistency condition. 

Obviously, strong Markovian consistency implies weak Markovian consistency, but not vice versa 
as will be seen in one of the examples in Section [31 As a matter of fact, it may happen that all 
components of X are Markovian in their filtrations. but X is not Markovian in its filtration (see e.g. 
Bielecki et al. Example 2.4.2]). 

From now on we assume that X = (X^ , . . . , X'^) is a Markov chain with values in a finite 
product space, say X = X^^j^A"", where A"" = {x", . . . ,2:m„} ^ However, to somewhat simplify 
the notation, in most of the paper we shall consider bivariate processes X only, that is, we put 
N = 2, and we take A{t) = [Xy{t)]x,y£X as a generic symbol for the P-infinitesimal generator of X. 
Thus, A(t) is an TO X m matrix, where m — mi ■ m2. We stress that restriction to bivariate case is 
for a notational convenience only. Our results naturally extend to the multivariate case. 

1.1. Semimartingale characterization of a finite Markov chain. Let us consider a cadlag 
process V defined on (fJ, J^, P), taking values in a finite set V C M^. 

For any two distinct states VjW £ V, we define an F^-optional random measure 7V„„, on [0, oo) 

by 

(4) iV,„((0,<])= J2 ^{v.-=v,v.=u,}- 

0<s<t 

We shall simply write Ny^{t) in place of Nyt^{{0,t]). Manifestly, Ny^{t) represents the number of 
jumps from state i; to state w that the process V executes over the time interval (0, t]. Let us denote 
by i^vw tbe dual predictable projection (the compensator) with respect to of the random measure 

Next, let us define a deterministic matrix valued function A on [0, oo) by 

(5) Ait) = [Xl{t)U^ev, 

where AJJ,'s are real valued, locally integrable functions on [0, cx)) such that for t E [0, cxd) and 
v,v G V, V w, we have 

Kit) > 

and 

Xlit) = - ^ Xlit). 

The following result, gives necessary and sufficient condition for cadlag process V with values in 
V to be a Markov chain. 
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Proposition 1.1. A process V is a Markov chain (with respect to ¥^ ) with infinitesimal generator 
A{t) iff the compensators with respect to of the counting measures N^jju{dt), v,w eV, are of the 
form 

(6) iyvw{{0,t])^ f t^v^^,yXl{s)ds. 

Jo 

Proof. It has been shown in Lemma 5.1 in [S] that a process is a Markov chain (with respect to F^) 
with infinitesimal generator A{t) iff the compensators with respect to F^'^ of the counting measures 
Ni,.w{dt), v,w eV, are of the form 

(7) ^'^((O,^]) = / l[v,_=,,}Kis)ds. 

Now, analysis of the proof of Lemma 5.1 in jj] indicates that the left hand limits Vt- used in Lemma 
5.1 in [S] can, in fact, be replaced with Vt, which proves the present result. □ 

Remark 1.1. A finite Markov chain V with a locally integrable generator A{t) is a semimartingale 
(see, e.g., Elliott et al. |12i Chapter 7.2]). The jump measure of V , say ji^ , can be expressed in 
terms of summation of the jump measures N^^ . Thus, in view of Proposition \1.1\ the infinitesimal 
characteristic of V (with respect to an appropriate truncation function), which is the compensator 
of fjY ( denoted by v^) is given in terms of summation of the compensators Vy^, . Indeed, one can 
easily check that if we define a truncation function h by 

:= xl{|2.|<jj-j, where d := -min{\v — w\ : v ^ w,v eV ,w eV}, 

then (0, 0, z^^) is the local characteristic of V , where 

v^{dx,dt)= ^ 6w-v{dx)vvw{dt), 

and S denotes the Dirac measure. 

1.2. Necessary and sufficient conditions for weak Markovian consistency in terms of 
semimartingale characteristics. Let us recall that we consider bivariate processes. We take 
n = I and we study the weak Markovian consistency of X with respect to X^. A completely 
analogous discussion can be carried out with respect to X^. 

For any two states x^ ,y^ G such that x^ 7^ 2/^, we define the following F^-optional random 
measure on [0, 00): 



(8) Kwmt])= ^ i{xi_=xi,xi=yi}- 

0<s<t 

We shall write N^iyi{t) in place of A^^i^i ((0, t]), and we shall denote by I'liyi the dual predictable 
projection (the compensator) with respect to F'^ of the random measure N^iyi- 

Next, for any two states x = {x^,x'^), y = {y^,y^) G X such that x y, we define an F^-optional 
random measure on [0, 00) by 



(9) ^xyi{0,t]) = ^ t^(^xl_=x\X'^_=x^),{Xl=y\X^=y^)}- 

a<s<t 

We shall write Nxy{t) in place of Nxy{{Q,t]), and we shall denote by v^y the compensator of iV, 
with respect to F^. 

It is easy to see that 

(10) Nl^y^{t)= N{-',--),{y',yMt)^ 
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and consequently (due to uniqueness of compensators) 

(11) i^xiyi((0,^]) = ''{x\x^),{v\v^){{0,t])- 

In view of Proposition II. 1[ we see that for any two distinct states x = {x^,x'^),y = (y^, y^) 6 X, 

1 2 

(12) V{x\x-i).,{y\y^){d't) = '^{(Xl.X^) = (x^.x^)]Ki^l^it)dt. 

Let us denote by i the compensator of the measure A^,;^i, i with respect to . 

X y X y 

Lemma 1.1. Assume that X is a Markov chain with respect to its own filtration. The W-^ - 
compensator of N^i has the form 

(13) Vl,y,{dt)^l^xi^,.^ Yl K'4(t)M^{xf=x-}\J'f')dt. 

x^,y^ex^ 

Proof. It follows from Lemma 4.3 in [5] that 

(14) ^l^y^idt) = Y Ep(l{(x^x?)=(.^.2)}A^^^2(i)|-^^')di 

x^,y^ex^ 

= E ^f^ykmA^{x}=x^}'s^{xf=x^}\j'^-)dt. 

x^,y^ex^ 

The process X is quasi-left continuous, since it is a Markov chain. Hence, X^ is also quasi-left 
continuous, so its natural filtration F"^ is quasi-left continuous and hence J'^ = (see Rogers 
and WiUiams dH III. 11]). Thus by HH) we have (O. □ 

Using Lemma 1 1.11 and Proposition 11.11 we obtain the following important result. 

Theorem 1.1. The component X^ of X is a Markov chain with respect to its own filtration if and 
only if 

(15) 

L{xi=xi} 



l/vi=.n E Ayv(i)Ep(l{x,^=.2}|.F/^')-l{A-=.i}Aii,i(t) dt(E,dF-a.s.yx\y'eX\ x V 2/' 



for some locally integrable functions ^l-iyi- The generator of X^ is A^{t) = [Xl.iyi{t)]xi ^yi^x'^ with 
A^i^i given by 

y^GX^.y^^x^ 

Proof. Assume that holds. Since X is a Markov chain, for each x^,y^ G , the F'^ 
compensator of N^i has, by Lemma [01 and ([T5|). the form 

^Uy^dt) = l{xi=xi}Aiij^i(t)di 

for some locally integrable deterministic function \\iyi. In particular, note that ((T5|) implies that 
A^i 1 is non- negative for x^ 7^ J/^- Then, by Proposition II. 1[ is a Markov chain with generator 

X y 

A^(f) = [A^ij^i(t)]a;i_yig;t'i. Conversely, assume that X^ is a Markov chain with respect to its nat- 
ural filtration with generator h}-{t) = [X\:iyi{i)\x^ ,y^£X^ ■ Then p5|) follows from Lemma [1.11 and 
Proposition 11.11 □ 



Remark 1.2. Note that ([T5| implies that 
(16) 

lW-nE^y^'SW^F(l{^l-^}l^' ^lW-n^i^y^(*) dt®d¥-a.s. 'ix\y^eX\ x^ ^ y\ 

Thus, condition (|16p is necessary for the weak Markovian consistency of X with respect to X^ . 
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1.3. Necessary and sufficient conditions for strong Markovian consistency. Since one of 
our goals is to relate the notions of weak and strong Markovian consistency, we shall discuss in this 
section necessary and sufficient conditions for strong Markovian consistency of our finite Markov 
chain. Towards this end let us first recall condition (M) from [5]: 

Condition (M): The generator matrix function A satisfies for every t>0 

(Ml) w = E ^S^'W' e -^^ ^^''2^' e -^^ ^ y'' 

and 

(M2) E = E ^^'SW' e X\ yx\y' e A-^ + y\ 

Next, consider the functions A^i i given, for i > 0, by 
(17) 

^VW= E ^yvW' ^\y'^X\x^^y\ \l^A^) = - E ^ivW' Vx^GA-i. 

Under condition (Ml), the functions A;^i,j^i are well defined and locally integrable, and it is 
straightforward to verify that they satisfy p^ . so that weak Markovian consistency holds for X 
with respect to X^. 

Result analogous to Theorem ll.il but with respect to component X^, reads: 

• The process X"^ is a Markov chain with respect to its own filtration if and only if 

(18) 

^{x-=.^} E ^yi^ WIEP = dt®dF-a.s. ^xW(.X\x^ ^ y" 

for some locally integrable functions X^2y2- Then the generator of X^ ish?(t) = [^'^2y2{t)]x^,y^£X^ 
with A^2j.2 given by 

\l.At) = - E ^'vW' Vx^eA-^. 

Now. if we define 

(19)' 

\l.y.{t)^ J2 ^yvW, x^y^ eX^,x' ^y\ \l.At) = - E ^'v^' ^ 

v^ex^ y^eX^,y^=^x^ 

then under condition (M2) the functions A^2 2 are well defined and locally integrable. It is straight- 

_ y 

forward to verify that they satisfy (US]), so that weak Markovian consistency holds with respect to 
X\ 

As a matter of fact, it was shown in [S] that conditions (Ml) and (M2) are sufficient for strong 
Markovian consistency to hold for X with respect to both its components: X^ and X^. It turns out 
however, that conditions (Ml) and (M2) are too strong; in particular, they are not necessary for 
strong Markovian consistency to hold for X with respect to its components. 

We now state a theorem providing sufficient and necessary conditions for strong Markovian 
consistency of X. 

Theorem 1.2. The component X^ of X is a Markov chain with respect to filtration W-^ if and only 
^f 



(20) l{xi=xi}E ^yij' W = l{xi=xi}^'-yiW dt^dF-a.s. yx\y'GX\x' ^ y' 

y^ex^ 
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for some locally integrable functions A^i^^i. The generator of is A^{t) ~ [^xiyi{'t)]x'^ ,y^ex^ with 
given by 

Aii.i(i) = - E ^'vW Vxie^i. 

y^eX^.y^^x^ 

The component of X is a Markov chain with respect to filtration F^' if and only if 

(21) \v'W-l{^?=x^}A'^2,2(i) dt^dV-a.s. yx^,y^eX^,x^ + y" 

for some locally integrable functions X'^2y2- The generator of X^ is A^(t) = [^x^y2{t)]x'' ,y^ex'^ with 
A^2^2 given by 

Proof. We will only give the proof regarding component X^ of X. For the component X^ the proof 
is analogous. 

Assume that ([20)) holds. Since X is a Markov chain, then, by ([TTjl . and ([^0]) . for each x^, 
y^ £ the F^compensator of N^i^i has the form 

u'^^iyi{dt) = E A^i^2(i)l{(xi,x|)=(2;i,2^2)j,(i< = l{xi=xi}E '^yi^' (^^'^^ A^i^i (0^^^ 

for some locally integrable deterministic function A^i^^i. Then, by martingale characterization, X^ 
is a Markov chain with respect to F'''" with generator A^(i) = [A^i^^i (t)]2;i_j,ig;t'i ■ Conversely, assume 
that X^ is a Markov chain with respect to filtration F'''- with generator A^(t) = [A^i^i (t)]j.i i. 
Then (PO)) follows from martingale characterization, pTjl and ([T^ . Indeed, we have 

'^{Xl=x^}K:^yi{t)dt = v'^xlyl{dt) = E A^i^2(t)l{(xi^x2) = (a-i,2:2)}rfi = l{Xi=a;i}E Kw 

x^,y^£X'^ y^£X^ 

a 

Remark 1.3. (i) It is clear that conditions (Ml) and (M2) imply conditions (|20ll and (j2ip . respec- 
tively. On the other hand, it is clear that conditions (j20p and (|2ip imply (|16p and (|18p . respectively, 
(ii) Even though conditions (Ml) and (M2) are stronger that conditions needed to establish strong 
Markovian consistency, they are very convenient to use for that purpose. In particular, they can be 
conveniently used to construct a strong Markov copula (cf. Section \2.1]) . In the next section we shall 
provide operator form of conditions (Ml) and (M2). 

Remark 1.4. Ball and Yeo [1] considered time homogeneous Markov chains with intensity matrix A 
satisfying some additional assumptions (cf. [TJ Condition 2.2\). In [TJ Theorem 3.1], it is proved that 
the marginal process X^ of time a homogenous Markov chain X is a time homogenous Markov chain 
in its natural filtration if and only if a condition equivalent to Condition (Ml) holds. However, if 
we omit the assumption of time homogeneity, then [TJ Theorem 3.1] does not hold; see our Example 
\3.2i below. Moreover, assumptions imposed m [1] ott. A exclude Markov chains with absorbing states. 

We shall see in Section [3] that there exist Markov chains that are weakly Markovian consistent, 
but not strongly Markovian consistent. 

1.4. Operator interpretation of necessary conditions for weak Markovian consistency, 
and of the sufficient condition (M) for strong Markovian consistency. For i = 1,2 and 

t > 0, we define an operator Ql, acting on any function f on X = x X^ , by 

(22) {Q\f){x')^^r{f{Xt)\Xl^x'), ^x^ X\ 

We also introduce an extension operator C*'* as follows: for any function /* on X^ the function 
(ji,* p defined on X by 

{C''*f'){x) = f\x^), \Jx = {x\x^)eX. 
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We have the following proposition, which will be important in the next section in the context of 
weak Markov copulae. 

Theorem 1.3. Fix i G {1,2}. The condition 

(23) QlA{t)C''* =A\t), t>0, 

where A'(i) = [A^ij^i(t)], with functions X\,iyi given by (jlSp for i = 1 and given by psp for i = 2, is 
necessary for weak Markovian consistency with respect to X'' . 

Proof. We give the proof for i = 1. It is enough to observe that (|16p is equivalent to ([^5)1 . Indeed, 
first note that is equivalent to the equality 

(24) iQlAit)C'-*g){x')= ^ Xly.it)giy') 

for an arbitrary function g on and G . Now, we rewrite the left hand side: 



E (e E ^(Vf=.^}l^t 

j^ex^ \x^ex^ y^i^x^ J 



Since g is arbitrary, ([2^ is equivalent to 

x^ex'^ y^ex^ 

which is exactly ([TO)) . □ 

In the next two propositions we shall consider an operator interpretation of condition (M) for 
strong Markovian consistency, and its connection with condition 



Proposition 1.2. Condition (Ml) is equivalent to 

(Nl): There exist generator matrix function = [X]c^yAx^ .y'^ ex'^ such that: 

(25) C^-'*K^{t)= K{t)C^'*, yt>0. 
Condition (M2) is equivalent to 

(N2): There exist generator matrix function = \\^^2y-2\x^ ^y'^ex^ such that: 

(26) C2'*A2(t) = A(t)C2'*, Vt>0. 

Proof. We only prove the first equivalence. The proof of the other one is analogous. 
We note that (|25p is equivalent to the equality 

(27) {C^'*K\t)g){x\x^) = (K{t)C^'*g){x\x'), y{x\x^) € X^ x X^ , 
for an arbitrary function g on X^ . By definition, the right hand side of (|27p is 

m)c^'*g){x\x^) = E K^4^t)^c''*9){y\y^)^ E 

(y\y'')<^x iv\v^)ex 

- E f E 4y^ii)] siv'), 

y^ex^ Wex^ J 
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and the left hand side of ([?7|) is given by 

Since g is arbitrary, we obtain that (Nl) is equivalent to existence of matrix function = [A^^j^J^,! ^ig^f i 
such that for each t > we have 

(28) Xly,{t) = J2 ^y^'y^'W ^^''2^' e ^-^^ ^ 

Hence, using the fact that A is the generator of a Markov chain we see that (Nl) is equivalent 
to (Ml). Finally, note also that in a view of it is straightforward to verify that matrix function 
A"'^ is a valid generator matrix. □ 

Proposition 1.3. Condition (pS)) implies (|23l) for i = 1 and condition implies /or i = 2. 

Proof. Since QJC"'* = Id for i = 1, 2, we have 

QjA(OC*'* = QiC'^*A\t) = A^t), f > 0, i = 1, 2. 

□ 

Remark 1.5. Another possible proof of Proposition^!^ is the following: Conditions (j25p anrf (j26p 
are sufficient for strong Markovian consistency of X (see Remark \1.4^ , which implies weak Markovian 
consistency of X , for which (|23p is a necessary condition. 

Remark 1.6. In the case of time homogeneous Markov processes, conditions analogous to (|25p and 
(j26p have been previously studied in [3] and |18j . and it has been shown that they are sufficient for 
strong Markovian consistency. So, (|25p and (j26p imply that each coordinate of the Markov process 
in question is a Markov process with respect to F^^ . It is worth noting that (|25p and (|26p agree with 
(10.60) of Dynkin |11| . if the latter is applied to f being a component projection function. 

Remark 1.7. The operator conditions (|25p and (|26p /or strong Markovian consistency can be 
interpreted in the context of martingale characterization of Markov chains. 

Let C*, i = 1,2, be the projection from x on the ith component. Fix i S {1,2} and 
Q < s <t. Since X is a Markov chain, for any function /' on X^ we have the representation 

(29) C''*f\Xt) = C'-*f\X,) + / {K{u){C'-* f')){Xu)du + Aff - Aff 

J S 

where ' '-^ is a martingale with respect to F^^. Thus, 

(30) nC'Xt) - f\C'X,) + J\a{u){C''* f^)){Xu)du + A/f - Mf 
// conditions (j25p and (|26p /loM t/ie« we may rewrite (j30p as 

(31) r(x,o = r(x:) + f {k\u)f^){xi)du + A/f ~ A/f 

which shows that X^ is a Markov chain with respect to F"^ . 

1.5. When Does Weak Markov Consistency Imply Strong Markov Consistency? It is well 
known that if a process X is a P-Markov chain with respect to a filtration F, and if it is adapted 
with respect to a filtration F C F, then A" is a P-Markov chain with respect to F. However, the 
converse is not true in general. Nevertheless, if AT is a P-Markov chain with respect to F, and F is 
V-immersed in F0, then we can deduce from the martingale characterization of Markov chains that 
X is also a P-Markov chain with respect to F. 



■^We say that a filtration F is V-immersed in a filtration F if F C F and every (P, F)-local-martingale is a (P, F) 
local-martineale. 
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Thus, if F"^ is P-inimersed in F"^, then weak Markovian consistency of X with respect to 
wiU imply strong Markovian consistency of X with respect to X*. In the following theorem we 
demonstrate that in fact this property is equivalent to P- immersion between F^ and F'''^ , given that 
weak Markovian consistency holds. 

Theorem 1.4. Assume that X satisfies the weak Markovian consistency condition with respect to 
X*. Then X satisfies the strong Markovian consistency condition if and only if is W' -immersed 
in F^. 



Proof. " =^ " We give a proof in the case of i = 1. By Proposition II . II the process 



Ml^y^{t) ■.= Nly,{t)- / dly^ids) 
J{0,t] 

is an F^ -martingale for every ^ since X^ is a Markov process with respect to its own 
filtration. By Jeanblanc, Yor and Chesney [TOl Proposition 5.9.1.1] it is sufficient to show that every 
F'^ -square integrable martingale Z is also an F'^-square integrable martingale under P. Using the 
martingale representation theorem (see Rogers and Williams |15l Theorem 21.15]) we have 

(32) Zt^Zo+J2[ g{s,x\y\^){Nl,y,{ds)-vl,y,{ds)) 



for some function g : (0, oo) x x x 17 — > R, such that for every , y^ the mapping (t,a;) i— >■ 
g{t, x^ jy-^ ,Lu) is F"^ -predictable and g{t, x^ , x^ ,uj) = 0, P-a.s. . The F^ -oblique bracket of M^i^i 

(i.e. the F^'^-compensator of {M^i yi)^) equal to (/q i^^ij^i ('^s))t>Oi a-^d therefore g satisfies the 
integrability condition 

(33) E/ \g{s,x\y')\'dly,{ds)] <^ Vr>0. 

From the assumption that weak Markovian consistency implies strong Markovian consistency we 
infer that X^ is a Markov chain with respect to F'^, and therefore MK, are F"^ -martingales for 

every x-^ ^ y^ . Moreover, the F"^-obhque bracket of M],Xy\ is also equal to (/p J^^i^^i ((is))t>o, and 
obviously for every x^,y^ the mapping {t,uj) — >■ g{t,x^,y^,uj) is F'^-predictable. Hence using ([5^ 
and (|33p we deduce that Z is also an F^-square integrable martingale. 

" <;= " Assume that F'^ is immersed in F^. Weak Markovian consistency for X^ implies that 
the process M^i^i is an F^ -martingale for every x^ ^ ■ By immersion we know that M^i^i are 
F'^-martingales for every x^ ^ y^ and therefore Proposition II . II implies that X^ is a Markov process 
with respect to F'^. □ 



2. Markov copulae 



We now turn to the problem of constructing a multivariate finite Markov chain whose components 
are finite univariate Markov chains with given generator matrices. 

This problem was previously studied in [S] and [5], for example, in the context of strong Markovian 
consistency. This meant that the components of the multivariate Markov chain constructed were 
Markovian both in their own filtrations and in the filtration of the entire chain. Thus, essentially, 
these references dealt with constructing of what we shall term here strong Markov copulae. 

In this paper, we shall additionally be concerned with weak Markov copulae in the context of 
finite Markov chains. It will be seen that any strong Markov copula is also a weak Markov copula. 

As in the previous section, in order to simplify the notation we shall consider bivariate processes 
X only. 
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2.1. Strong Markov copulae. The key observation leading to the concept of strong Markov copula 
is the following: Let there be given two generator functions A^{t) ~ i^xiyiit)] and A'^(t) ~ [A^2j,2(i)], 
and suppose that there exists a valid generator matrix function A{t) = [^yiy2{t)]x'^,y^i£X^,x^,y^GX^ 
satisfying ([T7)l for every x'^ G X^, and satisfying for every G X^. Then, Condition (M) is 
clearly satisfied, so that (cf. Remark 1 1.4p strong Markovian consistency holds for the Markov chain, 
X generated by A{t). 

Note that, typically, system pT|) and (|19p . considered as a system with given A^(t) = [A^ij^i(t)] 
and A^(i) = [A^2j^2(i)] and with unknown A{t) ~ \^^\^i{i)\x^,y^^x^,x'^,y'^!^x'^^ contains many more 
unknowns (i.e., A^i^2 {t\ G X^, x^, G X"^) than it contains equations. In fact, given that the 

cardinalities of X^ and X^ are Ki and A'2, respectively, the system consists of Ki{Ki~l)+K2{K2 — l) 
equations in A'iA'2(A'iA'2 ~ 1) unknowns. 

Thus, in principle, one can create several bivariate Markov chains X with margins X^ and X^ 
that are Markovian in the filtration of X , and such that the law of X* agrees with the law of a given 
Markov chain F', i = 1,2. Thus, indeed, the system ((T7)) and (|T9|) essentially serves as a "copula'd 
between the Markovian margins F^, and the bivariate Markov chain X. This observation leads 
to the following definition. 

Definition 2.1. Let and Y^ be two Markov chains with values in X^ and X^ , and with generators 
A^{t) = [\l.iyi{t)] andA^(t) = [A^2j^2(0]- A Strong Markov Copula between the Markov chains and 
Y^ is any solution to ([T7]) and such that the matrix function A(<) = [Ayiy2 (i)]a:i,yiGA'i.a:2,j,2g;t'2, 
with A^Ji5;2(i) given as 

(34) >^tS{t) = - E A^^^^'W' 

correctly defines the infinitesimal generator function of a Markov chain with values in X^ x X^ . 

Thus, any strong Markov copula between Markov chains Y^ and Y^ produces a bivariate Markov 
chain, say X = (X^, AT^), such that 

• the components X^ and X^ are Markovian in the filtration of A", 

• the transition laws of X* is the same as the transition laws of F*, i = 1,2, 

• If, in addition, the initial law of X' is same as the initial laws of F*, then, the law AT* is the 
same as the law of , i = 1, 2. In this case, according to terminology of [7], the process X 
satisfies the strong Markovian consistency condition relative to F^ and F^. 

It is clear that there exists at least one solution to (fT7|) and (fT9|) such that the matrix function 

1 2 

A{t) — [Xyiy2{t)]x'-.y^ex^,x^,y^ex^ is a valid generator matrix. This solution correspond to the case 
of independent processes X-^ and X^. In this case we have A{t) = /^(|)A^(t) + A^{t)®P where A(§B 
denotes tensor product of operators A and B (see Ryan jl6)). and where P is identity operator on 
X'. Matrix A{t) that corresponds to two independent processes can be also written more explicitly 

Xli,i{t) + Xl,^,{t), y^=x\y^=x\ 

A^vW' y'^x\y^=x^ 

K^y2{t), y^^x\y^=x\ 

0, otherwise. 

2.2. Weak Markov Copulae. The concept of weak Markov copula corresponds to the concept 
of weak Markovian consistency. We do not have any clear analytical characterization of the latter 
property, analogous to condition (M) that is sufficient for strong Markovian consistency. 



We use the term "copula" in analogy to classical copulae for probability distributions of finite-dimensional random 
variables (of. e.g. 1131 ). See also discussion in Section 12.31 
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Consequently, the concept of weak Markov copula is much more intricate than that of strong 
Markov copula, because it involves both probabilistic and analytical (indeed, algebraic in our case) 
characterizations. 

Definition 2.2. Let and be two Markov chains with values in and X^, and with generators 
A^{t) = [Xliyi{t)] and A'^{t) = [A^2y2(i)]> respectively. A Weak Markov Copula between Y^ and Y'^ 

is any matrix function A{t) = [)^yiy2 {t)]x^ .y^ ex^ .x^ .y^ex^ that satisfies the following conditions: 

(WMCl): A{t) correctly properly defines the infinitesimal generator of a bivariate Markov 

chain, say X ~ {X^,X^), with values in x , 
(WMC2): Conditions (|15p and ^TE\i are satisfied, so that X is weakly Markovian consistent. 

Thus, any weak Markov copula between the Markov chains Y^ and Y^ produces a bivariate 
Markov chain, say X = {X^,X'^), such that 

• the components X^ and X^ are Markovian in their own filtrations, but not necessarily 
Markovian in the filtration of X, and 

• the transition laws of X* is the same as the transition laws of F*, i = 1,2, 

• If, in addition, the initial law of X* is same as the initial laws of y*, then, the law X* is the 
same as the law of F*, i = 1,2. In this case, we say that the process X satisfies the weak 
Markovian consistency condition relative to Y^ and Y^. 

It is clear that any strong Markov copula between Y^ and Y^ is also a weak Markov copula 
between Y^ and F^. 

A possible way of constructing a weak-only Markov copula, that is a weak Markov copula, 
wiiich is not a strong Markov copula, is to start with the necessary condition (|23p and to find a 
generator matrix A(t) that satisfies this condition with given A^{t) and A^(i). Typically, the matrix 
A{t) found will generate a Markov chain satisfying the weak Markovian consistency condition relative 
to the Markov chains Y^ and Y^ generated by A^(t) and A^(t), respectively. This approach will be 
illustrated in Example 13.21 below. 

Remark 2.1. It needs to be strongly stressed that the issue of constructing weak-only Markov copulae 
is very important from the practical point of view. For example, it is important in the context of 
credit risk management since weak Markov copulae allow for modeling of default contagion between 
individual obligors and the rest of the credit pool (cf. [2] for a discussion) ; this kind of contagion is 
precluded in the context of strong Markov copulae. Thus, weak Markov copulae make it possible to 
tackle two critical modeling requirements: 

• They make it possible to model contagion between credit events in credit portfolios; equally 
importantly, they allow for modeling contagion between failure events in complex manufac- 
turing systems; 

• They make it possible to separate calibration of the model to univariate data ( credit default 
spreads, for example ), from calibration of the model to multivariate data ( spreads on credit 
portfolio contracts, such as collateralized loan obligations or collateralized debt obligations). 
This aspect of the Markov copula theory is of fundamental importance for efficient calibration 
of a model to market data. In [1] and [2] (see also references therein), the strong Markov 
copula theory was successfully applied to separate calibration of dependence in the pool of 125 
obligors (constituting an iTraxx index), from the calibration of univariate characteristics of 
the individual obligors. We are currently working on using the weak-only Markov copulae 
for such purpose. 

2.3. Classical copulae theory vs Markov copulae theory. It is useful to relate the concept of 
Markov copulae to the classical concept of copula function used in probability to construct multi- 
variate, finite dimensional random variables, with given marginal distributions. 

Recall that a function C : [0, 1]^ ^ [0, 1] is an iV— copula if, and only if, the following properties 
hold: 
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(1) for every j G {1, 2, N}, . . . , 1, 1, ■ • ■ , 1) = uf, 

(2) C is isotonic, that is C{u) < C{v) for all u,v G [0, 1]^ ,u < v; 

(3) C is N-increasing, that is 

J2 (-l)#{^'^"'^-=''^>C(u.) > 

w^{ui ,vi}x ...X {un -iVn} 

for all u,v e [0, 1]^, w < 

Let now Ui, . . . jUn be real valued random variables, with the corresponding cumulative distri- 
bution functions Fi, ^2, • ■ • j Fn, and let C be an A^-copula. Next, let the function F : — !■ [0, 1] 
be defined by 

(35) F(ui,M2, ...,MAr) = C{Fi{ui),F2{u2), ■ . . ,F/v(uAr)). 

It is the classical result due to Sklar [T7] that F is a cumulative distribution function of an R^-valued 
random variable, say W = {Wi, . . . , Wn), such that the law of Wn is the same as the law of J7„, 
n = 1, 2, . . . , A^. In other words, F is an iV-variate distribution function with margins Fi, F2, . . . , F^. 

Now, we have the following analogies between the classical copula theory and the Markov copulae 
(below, we use our convention that TV = 2): 

• random variables Ui and U2 correspond to Markov chains and y^, random variables 
Wi and W2 correspond to Markov chains and X^, and random variable W — {Wi, W2) 
corresponds to Markov chain X = {X^jX"^), 

• the generator functions A^(-) = [-^iljiyi (■)] and A^(-) = [A^2,y2(-)]j showing in equations ([T7|) 
and (|19p and in equations ([TS]) and (fT8|) , are analogous to the marginal distributions Fi and 
F2 showing in ([35]) . 

• in the case of strong Markov copula, the equations ([T7|) and ([T9| and any of their solutions, 
say A(-) = [''^yiy2 {■)]x^ GX^ ,y^ex'^ J which produces a valid Markov chain, is analogous to 
the pair (F, C) in ((35|l . 

• in the case of weak Markov copula, the equations ([T5|) and (|18p and any of their solutions, 
say A(-) = [^^^1^2 {')]x'- ,y'- GX'- ex^ J which produces a valid Markov chain, is analogous to 
the pair (F, C) in ((55|l . 

It needs to be stressed that we use the term "copula", in Markov copula, because of the above 
correspondences, and, really, for reason of tradition. In general, there is no copula functional that 
would map marginal Markov processes X" to a multivariate Markov process X (cf. discussion of 
this issue given in [5]). 

3. Examples 

As before, we take = 2 in the examples below. We shall present examples illustrating 

• Construction of a strong Markov copula (Example 13. ip . i.e., a construction of a two dimen- 
sional Markov chain X = {X^,X'^) with components X^ and X'^ that are Markovian in the 
filtration of X, and such that the transition laws of X^ agree with the transition laws of a 
given Markov chain F% i = 1,2. 

• Construction of a weak-only Markov copula (Example 13. 2p . i.e., a construction of a two 
dimensional Markov chain X ~ {X^,X'^) with the components X^ and X^ that are Mar- 
kovian in their own filtrations, but are not Markovian in the filtration of X, and such that 
the transition laws of X^ agree with the transition laws of a given Markov chain Y'\ i = 1,2. 

• Existence of a Markov chain for which weak Markovian consistency does not hold, that is, 
a Markov chain that can't serve as a weak Markov copula (Example 13. 3p . In this example, 
component X^ of Markov chain X = {X^,X'^) is shown to be not Markovian in its own 
filtration. 
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Example 3.1. Let us consider two processes, and Y^, that are time- homogeneous Markov 
chains, each taking values in the state space {0, 1}, with respective generators 



(36) 
and 

(37) 



A^ = 



1 

-{a + c) a + c 











1 

-{b + c) b + c 











for a,b,c > 0. 

We shall first consider the system of equations ([25]) and ([25]) for this example. In this case we 
identify C*'*, i — 1,2, with the matrices 



(38) 



C 



1,* 



fl 0\ 

1 

1 

V 1 y 



and C 



'2,* 



fl 0\ 

1 

1 

V 1 y 



It can be easily checked that the matrix A below satisfies ([^5)1 and 



(39) 



A 



(0,0) 
(0,1) 
(1,0) 

(1,1) 



V 



(0,0) 


(0,1) 


(1,0) 


(1,1) 


(a + b + c) 


b 


a 


c 





-(a + c) 





a + c 








-(b + c) 


b + c 















Thus, according to the theory of Section [51 A is a strong Markov copula between Y^ and Y^. 
Nevertheless, it will be instructive to verify this directly. Towards this end, let us consider the 
bivariate Markov chain X = {X^,X'^) on the state space 

i? = {(0,0),(0,l),(l,0),(l,l)} 

generated by the matrix A given by p9p . We first compute the transition probability matrix for X, 
for t > 0: 

/ g-(a+&+c)t g-(a+c)t^-[^_g-&tj g-(&+c)t^2— e^'**) g-(a+&+c)t_g-(&+c)t_g-(a+c)t^-[^ \ 



P{t)-- 



\ 



g-(a+c)t 








g-(b+c)t 





1 _ g-(a+c)t 

1 - e"(''+'=)* 
1 



Thus, for any t > 0, 



Similarly, for any t > 0, 



lim 



P{Xf., = 0\Xf = 0) - 1 



lim 



p(x,v, = o|xi = 0) - 1 



-{b + c). 
-{a + c). 



It is clear that X^ and X'^ are Markov chains in their own filtrations (as both chains are absorbed 
in state 1). From the above calculations we see that the generator of AT* is A*, i = 1, 2. 

To verify that A is a strong Markov copula between Y^ and F^, it remains to show that com- 
ponents X^ and X^ are Markovian in the filtration of X. This can also be verified by direct 
computations: indeed, 

P{X^_^^ = 0\X^ = 0,Xi = 0)-l P{Xl^,^ = 0\Xl=0,Xf = l)-l 

hm ■ = lim ■ 

h^a h h^o h 
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-(a + c) 



lim 



P{Xl^ = 0|Xi = 0) - 1 



or, equivalently, 

P(X,V = 01^1 = 0,Xf = 0) = P(X,V, = 0\Xl = 0,Xf = 1) = P(X,V, = 01^1 = 0) = e-("+^)^ 

so that condition ([5]) is satisfied for X-^, and similarly for X^. 

Note that in accordance with the concept of strong Markovian consistency, the transition inten- 
sities and transition probabihties for X^ do not depend on the state of X^: 

• No matter what the state of X^ is, whether or 1, the intensity of transition of X^ from 
to 1 is equal to a + c. 

• The transition probability of X^ from to 1 in i units of time, no matter what the state of 
X^ is, is equal to 

g-(&+c)t^2 — e^°*) + e^('^+^+':)* _ p-(b+c)t __ g-(a+c)t _|_ ^ _ g-(o+c)t^ 

An analogous observation holds for X^. Finally, note that and are independent if and only 
if c = 0. 

Example 3.2. Let us consider two processes, Y^ and Y^, that are Markov chains, each taking 
values in the state space {0, 1}, with respective generator functions 

-{a + c)+a{t) a + c-a{t)\ 

/ 



A\t) = 



and 

where 
a{t) = c 



-{b + c)+P{t) b + c-(3{t) 




-bt 



m 



(1 



— (a+c)t\ a 
^ I a+c 



g-(a+b+c)t _|_ g-at^]^ _ g-(b+c)t-)_|_ ' ^ ^"^ " ^-(a+b+c\t | g-b«(l g-fa+cU^ a ' 

for a,b,c> 0. 

Here we shall seek a weak Markov copula for Y^ and Y^. Thus we shall investigate the necessary 
condition (j23p . Towards this end we first note that in this example the matrix representation of the 
operator Q] takes the form 

P{X( =0, Xj =0|Xj =0) P{Xj =0, = 1|X( =0) P{Xj =1, Xj^ =0|Xj =0) P{Xj = 1, J!f(^ = 1|X( =0) 
P{X( =0, X( =0|X( = 1) P{X( =0, Xj^ = 1|X( =1) P{X( = 1, JfJ^ =0|Jft =1) P{Xj = 1, X,^ = 1|X( =1) 

and similarly for . It turns out that a solution to the necessary condition (|23p is a valid generator 
matrix 



Ql = 



(40) 



A: 



/ 


-{a + b + c) 


6 


a 


c 


\ 







—a 





a 












-b 






V 














/ 



where a,b > and c > 0. Verification of this is straightforward, but computationally intensive, and 
can be obtained from the authors on request. 

Since condition (j23p is just a necessary condition for weak Markovian consistency, the matrix A 
in ((40|) may not be a weak Markov copula for Y^ and Y^. This has to be verified by direct inspection. 

Let us consider the bivariate Markov chain X — {X^,X'^) on the state space 

i? = {(0,0), (0,1), (1,0), (1,1)} 

generated by the matrix A given by pO|) . 
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Arguing as in the previous example, it is clear that the components and are Markovian 
in their own filtrations. We shall show that: 



X'^ and X'^ are NOT Markovian in the filtration F^, and 

the generators of X^ and X^ are given by (|¥T|l and (jH]), respectively. 



We first compute the transition probability matrix for X , for t > 0: 

-bt 



/ b+c ^ ' / a+c V a+c b+c/ a+c 

e""* 1 - e-"* 

e"''* 1 - e-''* 



\ 

It follows that 

h 



5 + c 

^ P(X,V;, - m\ = 0,^2 = 1) = e^-* 

unless c = 0, which is the case of independent X^ and X^ . Thus, in general, X^ is NOT a Markov 
process in the full filtration. Similarly for X^ . 

We shall now compute the generator function for X^ . As in the previous example, for any i > 0, 

P(A,^^, ^ 0|X,^ = 0) - 1 P(X,^ = 1,X,^^0) 

1™ Z = + C) + C ——2 — . 

Similarly, for any t > 0, 

^ 0|Xi = 0) - 1 P(Xi^O,X-^^l) 

iTo ^ = + ^) + ^ p{xi = 0) • 

Thus, both X^ and are time-inhomogeneous Markov chains with generator functions, respec- 
tively. 

(41) A\t)={ -(" + '^)+^ pW4 " + '^-" pW4 j 
and 

(42) A^{i^={ ~(^ + ") + " Ax,--o) ^ + pV,^^^) \ 

It is easily checked that A^(i) = A^(i) and J^(t) = A^(t), as claimed. Consequently, the matrix A 
in (|40p is a weak Markov copula for and y^, but it is not a strong Markov copula for and Y^ . 

Finally, note that the transition intensities and transition probabilities for A^ do depend on the 
state of A^: 

• When A is in state (0, 0) at some point in time, then, the intensity of transition of A^ from 
to 1 is equal to a + c; when A is in state (0,1) at some point in time, the intensity of 
transition of A^ from to 1 is equal to a. 

• When A is in state (0,0) at some point in time, then, the transition probability of A^ from 
to 1 in t units of time is 



e - e-(«+'=)*)^ + 1 + e-(»+''+c)t ( _ ^\ g _ e 

a + c \a + c b + cj a + c b + c 

when A is in state (0, 1) at some point in time, the transition probability of A^ from to 1 
in t units of time is 

An analogous observation holds for A^, that is, the transition intensities and transition probabilities 
for X^ do depend on the state of A^. 
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Example 3.3. Here we give an example of a bivariate Markov chain which is not weakly Markovian 
consistent. 

Let us consider the bivariate Markov chain X = (X^, X"^) on the state space 

{(0,0), (0,1), (1,0), (1,1)} 

generated by the matrix 



/ 


-{a + b + c) 


b 


a 


c \ 







-(d + e) 


d 


e 










-f 


f 


v 








9 


-.9/ 



We denote by Hq i the process that counts the number of jumps of the component X^ from state 
to state 1. The F^'^-intensity of such jumps is 

(44) l{xi=o,A7=o}(^ + c) + l{xi=i,x?=o}/, 
so the optional projection of this intensity on F'^ has the form 

(45) (6 + c)P(X/ - 0, Xf = 0| J-f) + fPiXl = 1, X? = 0| J-D- 
Since {Xf = 0,^2^2 = 1} ^ i^t = 1}= on the set {Xf = 0,Xl^^ = 1} we have 

(46) ¥{Xl = 0, Xf = 0\Xf = 0, = 1) = 0, P{Xl = 1, Xf = 0\Xf = 0, = 1) = 1. 
Therefore the above optional projection, on the set {Xf = 0,Xf^2 = l}i is equal to 

(47) f¥{Xl = 1, Xf = 01^2 = 0, = 1) = /. 
However, on {Xf = 0} the above optional projection is equal to 

(6 + c)F{Xl ^ 0, Xf = 0\Xf = 0) + f¥{Xl = 1, Xf = 0\Xf = 0) 
= ib + c- f)FiXl = 0, Xf = 0\X'^ = 0) + /. 

Assuming that the process X starts from (0, 0) at time t = 0, it can be shown that ¥{Xf ~ 0, X^ = 
0\Xf = 0) > 0. Verification of this is straightforward, but computationally intensive, and can be 
obtained from the authors on request. Thus, if + c 7^ /, then the optional projection on J-"^ of 
the F'^ intensity of Hq i depends on the trajectory of X^ until time t, and not just on the state of 
X'^ at time t. Thus, X^ is not Markovian in its own filtration. It is obviously not Markovian in the 
filtration of the entire process X either. 
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